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NEW  SYNDROME  DECODING  TECHNIQUES  FOR 
CONVOLUTIONAL  CODES  OVER  6F(q) 


I.  S.  Reed 


I.  INTRODUCTION 

-~>This  is  a  final  report  on  a  one-year  study  of  techniques  for  improv¬ 
ing  the  encoding  and  decoding  of  error-correcting  codes.  For  the  previous 
three  quarters  emphasis  was  given  to  methods  for  making  the  encoding  and 
decoding  of  Reed-Sol omon  codes  more  efficient.  These  methods  included 
the  possibility  [1]  of  using  Winograd's  fast  transforms  for  transform 
encoding  and  decoding  of  Reed-Sol omon  codes,  and  studies  for  simplifying 

the  arithmetic  of  the  Galois  fields  used  in  error-correcting  codes.  The 
fe^-  (S’  \ 

latter  topic-lead'  to  an  investigation  [2]  of  the  architecture  needed  to 
realize  Berlekamp's  new  bit-serial  multiplier  [3]  of  Galois  field  ele- 
ments  and  its  generalization  [4]  to  a  symbol-serial  multiplier.  During 
the  last  quarter  a  new  syndrome  decoding  algorithm  for  convolutional 

r) 

codes  (CC)  was  conceived  by  the  author  [5].  In  the  preoont  report  this 


lidea  rfs  extended  to  a  greater  generality.  {f— 


First,  the  algebraic  nature  and  structure  of  convolutional  codes 
over  a  Galois  field  GF(q)  is  reviewed  and  developed.  This  background  is 
then  used  to  find  the  general  solution  of  the  syndrome  equations  for  the 
error  polynomial  vector  e{D)  where  D  is  the  unit  delay  operator.  In 
particular  it  is  shown  that  these  syndrome  equations  are  linear  Diophantine 
equations  over  the  ring  of  polynomials  In  D  and  with  coefficients  in  GF(q). 
The  methods  of  solving  linear  Diophantine  equations  for  the  integers  are 
then  used  to  solve  the  syndrome  equations  for  e(D). 
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The  set  of  Diophantine  solutions  of  the  syndrome  equations  consti¬ 
tutes  a  coset  of  the  convolutional  code  space  or  subgroup.  The  problem 
of  syndrome  decoding  is  to  find  the  minimum  weight  polynomial  vector 

A 

e(D)  of  this  coset  to  subtract  from  the  received  polynomial  vector  z( D) 

/v 

to  yield  an  estimate  y(0)  of  the  transmitted  polynomial  vector.  In  order 

A 

to  find  e(D)  efficiently  a  new  recursive,  Viterbi-like  algorithm  is  de¬ 
vised.  This  new  syndrome  decoding  algorithm  is  presented  in  this  report 
by  example. 

For  a  fixed  convolutional  code  the  new  recursive  syndrome  decoder 
for  CC  appears  to  be  comparable  in  complexity  to  the  Viterbi  decoder 
except  that  in  the  new  decoder  fewer  comparisons  are  required  and  the 
control  logic  is  considerably  simpler.  However,  if  one  wishes  to  design 
a  CC  decoder  for  several  different  rate  codes  of  the  same  constraint 
length,  it  appears  that  the  principles  of  the  new  syndrome  decoder  may 
yield  a  simpler  system  than  one  could  achieve  using  the  Viterbi  methods. 
Thus  for  variable  rate  communication  systems  that  utilize  convolutional 
codes  the  new  syndrome  decoding  concept  appears  to  have  an  advantage 
over  the  standard  Viterbi  decoding  techniques.  A  precise  quantification 
of  this  comparison  is  a  topic  for  future  study. 


II.  ALGEBRAIC  STRUCTURE  OF  CONVOLUTIONAL  CODES  (CC) 


Let  aQ,  a.j,  ^  •••  be  any  sequence  of  symbols  from  the  finite  field 
F  =  GF(q)  of  q  elements.  Further  let  D  be  the  unit  delay  operator.  D 
operates  on  a  function  x(n)  of  discrete  time  in  accordance  with  the 
definition 


D  x(n)  *  x(n  -  1) 


.  jjf. 


~¥>v  mi 


mm*™**3 
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for  all  n.  In  terms  of  D  the  sequence  {a.}  is  conveniently  represented 

v 

by  what  is  called  its  O-transform, 

A(D)  =  3q  +  a^j  D  +  0  +  ...  ,  (2) 


in  powers  of  the  operator  D. 

One  way  to  understand  A(D)  is  to  consider  A(D)  to  be  the  output  of 
a  symbol  generating  box.  At  the  present  instant  of  time  the  output  is 
a0;  at  one  unit  of  time  later  the  output  is  a-j ,  the  coefficient  of  0; 
at  two  units  of  time  later  the  output  is  a 2 »  the  coefficient  of  D  ;  and 
so  forth.  Looked  upon  in  this  manner  the  D-transform  converts  an  abstract 
sequence  {a-}  of  symbols  from  GF(.q)  into  the  same  sequence  of  symbols 

J 

but  now  ordered  in  time.  Assume  in  (2)  that  the  coefficients  commute 
with  D**. 

The  input  to  a  convolutional  encoder  is  a  set  of  k  discrete- time 
input  sequences.  In  terms  of  D-transforms  this  input  is  represented 
by  the  vector 


x(.D)  =  [x^ (D) ,  x2CD),  ...  ,  xk(D)]  (3) 


where 


XjCD)  »xoj  +xld  D  +  x2j  D2  +  ... 

for  (j  ■  1,  2,  ...  k)  with  coefficients  in  GFCq). 

Very  simply  an  encoder  for  a  CC  is  some  linear  sequential  circuit 
over  the  finite  field  GF(q)  with  vector  input  x(D)  and  vector  output 
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y(D)  *  Cy^O),  y2(0) .  ...  .  yn(0) ]  (4) 


where  n  >  K  and 

yr(D)  =  y Q|»  +  y^j.  9  +  y2r  d  +  . . . 

for  (r  =  1,  2,  ...  n).  For  the  standard  (n,  k)  convolutional  code 
((n,  k)  CC)  the  linear  relationship  between  the  input  and  output  is 
assumed  to  have  finite  memory  so  that  it  can  be  expressed  as  a  matrix 
convolution  of  form 

y(D)  =  x(D)  6(D)  (5) 


where  G(D)  is  a  K  x  n  matrix  of  polynomials  of  finite  degree  in  D  over 
GF(q).  G(D)  in  (5)  is  usually  called  the  generating  matrix  of  the 
(n,  k)  CC  or  k/n  rate  CC  and  has  the  specific  form,  as  a  k  x  n  matrix. 


G(D)  3 


9] i C D) »  >  ...  9]n 

92i (D) ,  922(D) ,  ...  g2n 


9kl(D)’  9k2(D)’  *•*  9kn 


(6) 


The  maximum  degree  M  of  the  polynomials  in  G(D)  is  called  the  memory, 
and  the  constraint  length  of  the  code  Is  L  *  M  +  1. 

The  elements  of  G(D)  in  (G)  are  polynomials  in  D  over  the  finite 
field  F  3  GF(q).  The  set  of  all  such  polynomials  in  D  over  a  field  F 
is  an  infinite  ring  F[D]  as  well  as  an  integral  domain  since  it  has  no 
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divisors  of  zero.  It  can  also  be  demonstrated  that  F[D]  is  a  Euclidean 
ring  (see  [6,  Secs.  3.7  and  3.9). 

If  the  elements  of  6(0)  in  (6)  had  been  restricted  only  to  members 
of  field  F,  it  would  generate  a  one  dimensional  vector  space  over  field 
F.  However,  since  G(D)  is  a  k  x  n  matrix  with  elements  in  F[D],  the  in¬ 
tegral  domain  in  D  over  F,  6(0)  generates  what  is  called  a  module  over 
the  ring  F[D].  A  module  has  the  same  postulates  as  a  vector  space  ex¬ 
cept  that  its  scalars  are  elements  of  a  ring  rather  than  a  field 

To  characterize  the  algebraic  properties  of  different  generating 
matrices  6(0)  over  integral  domain  F[D]  we  follow  the  lead  of  Forney  in 
[7].  Forney  bases  his  study  of  CC  on  the  well-known  invariant-factor 
theorem  of  matrices  over  an  integral  domain.  The  statement  of  this  the¬ 
orem  is  reproduced  for  ring  F[D]  as  follows: 

Invariant-Factor  Theorem:  If  F[D]  is  the  integral  domain  F[D]  and 
6  is  a  k  x  n  matrix  over  F[D],  then  6  has  the  invariant-factor  decompo¬ 
sition 


G  *  A  r  8  (7) 

where  A  is  a  k  x  k  matrix  over  F[D]  with  an  inverse  A"^  with  elements 
in  F[D];  B  is  a  n  x  n  matrix  over  F[D]  also  with  an  inverse  B~^  with 
elements  in  F[D] ;  and  r  is  a  k  x  n  matrix  over  F[D]  of  form 

r  =  [r1 ,  o]  (8) 


withO,akxn-k  matrix  of  zeros  and  a  diagonal  matrix  of  form 
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Y'j »  0  ...  0 

0 1  Y£  •  •  •  0 

rl  =  ;  (9) 

6,  0,  ...  Yk 

over  R. 

The  diagonal  elements  y^  in  (9)  for  1  <  i  <  k  are  elements  of  F[D] 
and  are  called  the  invariant  factors  of  6.  The  invariant  factors  are 
unique  and  can  be  computed  as  follows:  Let  Aq  =  1 .  Let  A^  be  the 
greatest  common  divisor  (GCD)  of  all  i  x  i  subdeterminants  (minors)  of 
G.  Then  Y-j  =  A^/A^  If  Y^+i  t  0»  then  Yj  divides  y^+i  f°r  1  = 

1 ,  2,  ...  k  -  1 . 

Forney  in  [6]  sketches  a  proof  of  this  theorem.  Other  more  ele¬ 
mentary  and  detailed  expositions  of  this  theorem  can  be  found  in  certain 
classic  works  on  modern  algebra,  e.g.,  see  [8;  Sec.  10,  Ch.  III]. 

Rather  than  give  a  proof  of  this  theorem  it  is  perhaps  better  here  to 
illustrate  the  computational  technique  involved  by  an  example. 

For  this  example  let  F  =  GF(2)  and  consider  the  generating  matrix. 


GCD)  =  G  = 


(10) 


where  A  is  a  2  x  2  matrix  and  B  is  a  3  x  3  matrix,  both  over  F[D] . 
Matrices  A  and  B  can  be  obtained  as  a  product  of  elementary  row  and 
column  operations,  respectively.  The  elementary  operations  are  of  three 
types: 
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1)  The  Interchange  of  any  two  rows  (columns)  Is  an  elementary  op¬ 
eration  of  type  1. 

ii)  Let  any  row  (column)  be  multiplied  by  an  element  of  F[D].  The 
addition  of  this  result  to  any  other  row  (column)  is  an  elementary  op¬ 
eration  of  type  2. 

ill)  The  multiplication  of  any  row  (column)  by  a  nonzero  scalar 
of  F[D],  i.e.,  a  nonzero  element  of  F,  is  an  elementary  operation  of 
type  3. 

One  procedure  for  finding  A  and  B  in  (10)  is  to  express  (10)  in  the 

form. 


and  reduce  the  left  side  to  the  form  of  r  in  (10)  by  elementary  transfor¬ 
mation.  To  put  zeros  in  the  second  column  of  the  first  row  multiply  the 
first  column  by  1  +  D  and  add  the  result  to  the  second  column  of  the  matrix 
on  the  left.  This  same  transformation  is  performed  at  the  same  time  on 
the  3x3  identity  matrix  on  the  right  side  of  the  equation.  The  result 
is 
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transformation  matrix 


1  1+D  0 


0  0  1 


of  type  2.  Proceeding  step  by  step  in  this  fashion  it  is  readily  veri¬ 
fied  that  the  left  side  of  (11)  reduces  finally  to 


1  0  0 
0  1  0 


1+D  1 


1  1+D 


G  I  0  1 


0  1  0  1+d]  10  0  10  0 

0  0  1  0  0  1  1  0  1  0 

1 J  [0  0  1  0  0  1 J  |_0  1  1 


1  0  0  ■  I  1  0  0 


0  D  1  I  I  0  0  1 


°1 

[l+D  1 


1  1+D  D+D 


0  1+D  l+D+D' 


=  A"1  G  B"1 

? 


For  F  *  GF(2)  it  is  easy  to  verify  that  an  elementary  matrix  E  over 
F[D]  is  its  own  inverse,  i.e.,  E”^  =  E  for  an  elementary  matrix  of  types 
1,  2  or  3.  Thus  solving  for  G  in  (12)  yields 


O 
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as  the  invariant-factor  decomposition  of  G(D)  in  (10). 

Let  the  generating  matrix  of  a  CC  have  the  invariant-factor  decom¬ 
position  in  (7).  Then  the  output  of  the  encoder  in  (5)  can  be  expressed 
as 

y(D)  =  x(D)  G{ D)  =  x(D)  A(D)  r(D)  B(D)  (14) 

where  A(D)  and  B ( D)  have  inverses  A”\d)  and  B"^(D),  respectively,  and 
r(D)  is  the  k  x  n  matrix 

Y-j  ( D)  0  ...  0  ...  0 

r(D)  =  0  0  0  (15) 

_0  0  ...  Yk(0)  •••  0_ 

of  invariant  factors  y-|(D)»  •••  Yk(D)« 
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For  the  encoding  operation  in  {14)  to  be  useful  in  the  context  of 
a  comnuni cations  system  it  is  desirable  that  the  mapping  of  k-vectors 
x(D)  onto  n-vectors  y{D)  over  F[D]  be  one-to-one  and  reversible.  For 
this  to  be  true  there  must  exist  a  right  inverse  matrix  G"^(D)  of  ma¬ 
trix  G(D).  If  G'^(D)  exists,  then 

y(D)  G”1  (D)  =  x(D)  G(D)  G”"1  { D)  =  x(D)  Ik  =  x(D)  (16) 

where  Ik  is  the  k  x  k  identity  matrix  and  x(D)  is  uniquely  recoverable 
from  the  encoded  message  y(D).  It  will  be  assumed  henceforth  that  the 
generating  matrix  G(D)  has  a  right  inverse  and  that  this  inverse  is 
realizable  in  finite  delay  time. 

By  the  invariant-factor  theorem 


G(D)  =  A(D)  T(D)  B(D) 

Thus  for  G  \d)  to  exist  the  last  invariant  factor  of  r(D)  must  not  be 
zero,  i.e.,  yk  i  0.  For  otherwise,  if  yk  s  0,  then  G(D)  would  have  rank 
less  than  k  and  as  a  consequence  no  inverse. 

If  yk  f  0,  then  it  can  be  verified  that 

G_1 (D)  =  B_1 (D)  T*(D)  A_1(D)  (17) 


is  an  inverse  for  G(D)  where  r*(D)  is  an  n  x  k  matrix  with  diagonal  ele¬ 
ments  yj1  of  form 


r*(D) 


r"1 (D) 
o 


(18) 


with  ^(D)  the  inverse  of  1*^(0)  in  (9),  i.e., 

y-^D),  0  ...  0 

0  Y^tD)  ...  0 

2  (19) 

•  • 

•  • 

0  0  ...  y^(D) 

If  deg  Yk(0)  >  0,  then  by  (19),  (18)  and  (17)  the  circuit  to  realize  (16) 
would  not  be  feedback-free. 

Massey  and  Sain  [9]  proved  that  an  inverse  G~^(D)  or  some  delayed 
version  of  it  must  be  feedback-free  in  order  to  avoid  CC  that  give  rise 
to  catastrophic  error  propagation.  Therefore,  for  an  encoder  to  be  use¬ 
ful  one  must  choose  it  to  be  feedback-free.  If  G  ^(D)  is  feedback-free, 
deg  Yk( D)  *  1  and  y-j  =  y2  . . .  Yk  *  1  so  that  T  must  have  the  form 


r-’(D)  • 


r  =  [ik,  o]  (20) 

where  IK  denotes  a  Kx  K  identity  matrix  and  0  denotes  a  K  x  (n  -  K) 
matrix  of  zeros. 

The  above  properties  needed  for  a  useful  encoder  are  recapitulated 
in  the  following  definition  of  a  basic  encoder  given  by  Forney  [71. 

Definition:  A  basic  encoder  G(D)  is  a  CC  with  a  feedback-free  in¬ 
verse  G-1(D).  Both  G(D)  and  G-1(D)  are  polynomial  matrices  over  F[D], 
such  that  G(D)  G’^D)  =  IR. 

It  was  shown  in  detail  by  Forney  [7]  and  briefly  above  that  an  en¬ 
coder  is  basic  if  and  only  if  it  is  polynomial  over  F[D]  and  has  all 
its  invariant  factors  equal  to  one.  Henceforth  in  this  report  only 


basic  encoders  for  CC  will  be  treated  so  that  by  (20)  and  the  invariant- 
factor  theorem  the  generating  matrix  for  an  (n,  k)  CC  has  the  form 


G(D)  =  A(D)  [Ik,  0]  B(D)  (21) 

where  1^  is  the  k  x  k  identity  matrix. 

Forney  in  [7,  Appendix  I]  exhibits  a  parity-check  matrix  H(D)  over 
F[D]  for  a  generating  matrix  which  is  equivalent  to  G(D)  in  (21).  It 
is  shown  here  that  this  parity-check  matrix  is,  in  fact,  the  parity- 
check  matrix  of  all  generating  matrices  equivalent  to  (21)  in  the  sense 
of  Forney. 

To  treat  the  parity-check  matrix  the  Euclidean  ring  F[D]  is  extended 
to  the  field  F(D)  of  quotients  or  rational  functions  of  polynomials  in 
F[D],  e.g.,  see  [8;  Sec.  3.8].  In  terms  of  sequences  field  F(D)  is  in 
one-to-one  correspondence  with  the  field  S  of  all  possible  infinite  se¬ 
quences  that  can  be  generated  by  an  impulse  passed  through  all  finite 
memory  linear  circuits  with  or  without  feedback. 

Let  g^(D),  g^(D),  ...,  g^(D)  be  the  k  rows  of  matrix  G(D) 
in  (21).  Since  G(D)  has  rank  k. 


V  -  j.IT  ctj(D)  g(i)(D)  |ctj(D)  e  F(D)j 


is  a  k-dimensional  vector  space  with  respect  to  the  field  F(D)  of  scalars 
or  it  is  equivalent  to  the  field  S  of  sequences.  The  null  space  V  of 
V  is  a  vector  space  with  field  F(D)  of  scalars  of  dimension  n  -  k  (see 
[9,  Sec.  3.2]).  Let  H(D)  be  any  matrix  with  coefficients  in  ring  F[D]  of 


-/C,  ..."  y.. 
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rank  n  -  k  which  has  its  row  space  equal  to  V  .  Then  the  rows  of  H(D) 
constitute  a  basis  for  V  .  Thus  V  is  a  null  space  of  V  if  and  only  if 


for  any  vector  y(D)  e  V, 


y(D)  HT{D)  =  0 


Since  g^(D)  e  V  for  (j  =1,  2,  ....  k)  condition  (22)  implies, 

G(D)  HT(D)  =  0  (23) 

An  explicit  method  for  constructing  a  parity  matrix  H(D)  of  all 
generating  matrices  G(D)  with  form  (21)  will  now  be  given.  The  coeffi¬ 
cients  of  the  parity-check  matrix  H(D),  developed  by  this  technique, 
will  be  polynomials  in  D,  i.e.,  elements  from  the  Euclidean  ring  F[D] . 

Let  the  first  k  rows  of  matrix  G  in  (21)  be  a  submatrix  B-|  and  the 
last  (n  -  k)  rows  of  B  be  a  submatrix  Bg.  Then  B  is  the  matrix 


.  V 

-B2. 


in  terms  of  submatrices  B^  and  B2-  Similarly  denote  the  first  k  columns 
of  the  inverse  matrix  B~^  of  B  by  B^  and  denote  the  last  (n  -  k)  columns 
of  B’1  by  B£.  Then  the  inverse  of  B  is  the  matrix 


B'1  -  [Bj,  B£] 


Multiplying  (24)  and  (25)  yields 


IP 


wmmrr^- 
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-1  _  B1B1»  BiB2 
B2Bj,  B2B^ 


V  0 

°*  *n-» 


and  the  matrix  identities. 


B-| B-j  *  IK,  BgB-j  =  0  and 

B2B1L=0*  B2B2  =  !n-k 


H(D)  =  (B^)T, 


where  "T"  denotes  transpose  and  B2  is  defined  in  (25),  be  a  candidate 
for  the  parity-check  matrix  of  G(D)  in  (21).  Multiplying  G(D)  in  (21) 
by  the  transpose  of  H(D)  in  (28)  produces  by  (24)  and  (27), 


G(D)  HT(D)  =  A[Ip  0]  J^1  |b£ 


-  [A,  0] 


[A,  0] 


Since  the  n  -  k  rows  of  H(D)  are  the  n  -  k  columns  of  the  invertible 
matrix  B”1 ,  these  rows  must  be  linearly  independent.  Thus  H(D),  as 
defined  in  (2P),  has  rank  (n  -  k)  and  Is  a  valid  parity-check  matrix 
for  the  general  basic  encoder  G(D),  given  in  (21). 


The  parity-check  matrix  H(D),  associated  with  the  genera?  k  x  n 
generator  matrix  G(D)  of  a  basic  encoder,  is  given  by  (28).  However, 
for  two  special  cases,  the  systematic  (n,  k)  CC  and  the  non -systematic 
(n,  1)  CC  a  parity-check  matrix  can  be  found  more  directly.  For  example, 
for  the  systematic  (n,  k)  CC  the  parity-check  matrix  has  form  G(D)  = 

[1^,  P( D) 3  where  1^  is  the  k  x  k  identity  matrix  and  P(D)  is  a  k  x  (n  -  k) 
matrix  of  polynomials  over  F  =  GF(q).  In  this  case  it  is  readily  veri-  . 
fied  [9]  that  H(D)  =  [-PT( D) •  I  ^3  is  a  parity-check  matrix. 

The  generator  matrix  for  the  non-systematic  (n,  1)  CC  has  by  (6) 
the  form 

G(D)^[gi(0),  g2(0),  ...  gn(D)]  (30) 

where  for  simplicity  the  first  subscript  of  g^D)  has  been  dropped. 
Condition  (23)  for  the  (1  x  n)  generating  matrix  G( D)  in  (30)  is  easily 
shown  to  be  satisfied  by  the  (n  -  1)  x  n  matrix 

92(D) »  9j(D)»  D,  •••»  0 

9,s(D) ,  0  97(D),  ...,  0 

H (0)  =  *  *  (31) 

9n( D) ,  0,  0,  •••»  ^(D) 

so  that  it  is  a  parity-check  matrix  of  the  (n,  1)  CC  generated  by  G(D) 
in  (30). 

To  illustrate  how  to  use  (28)  to  compute  a  parity-check  matrix 
consider  again  the  example  of  a  generating  matrix,  given  in  (10).  By 
(12)  the  matrix  B"1  for  this  G  is 
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1+D  D+D2 
D  1+D2 
1+D  1+D+D2 


so  that  by  (25)  and  (28) 

H(D)  =  (Bp1  =  [D  +  D2,  1  +  D2,  1  +  D  +  D2], 


(32) 


(33) 


the  transpose  of  the  last  column  of  B"^  in  (22).  It  is  easily  verified 
that  (23)  satisfies  (23),  i.e.,  G(D)  H^(D)  =  0,  and  that  H(D)  is  of  rank 
one.  Hence  H(D)  in  (23)  is  the  parity-check  matrix  of  the  (3,  2)  CC 
with  generating  matrix  G(D)  in  (10). 

In  the  next  section  the  parity-check  matrix  will  be  used  to  obtain 
the  syndrome  of  the  received  CC.  A  new  decoding  algorithm  will  then  be 
presented  by  example. 


III.  SOLUTIONS  OF  SYNDROME  EQUATION  FOR  CONVOLUTIONAL  CODES 

Let  y(D)  be  transmitted  CC  in  accordance  with  (5)  where  G(D)  is 
the  generating  matrix  for  a  basic  encoder.  Next  let  z(D)  =  y(D)  +  e(D) 
be  the  received  code  possibly  corrupted  by  an  error  or  noise  sequence 
e(D).  The  syndrome  S(D)  of  z(D)  is  defined  by 

S(D)  =  z(D)  HT( D)  (34) 

where  H(D)  is  syndrome  (28)  for  the  basic  encoder. 


-17- 


S(D)  =  (y(D)  +  e(D))  HT(D)  =  e(D)  HT(D)  +  x(D)  G(D)  H7(D)  (35) 

But  by  construction  (23)  is  satisfied,  i.e.,  G(D)  H7(D)  =  0.  Hence  the 
last  tern  of  (.35)  vanishes  and 


S(D)  =  e(D)  HT(D) 


(36) 


'is  the  syndrome  in  terms  of  an  error  sequence  or  polynomial  e(D).  The 
syndrome  for  a  basic  (n,  k)  CC  is  by  (.36)  totally  independent  of  the 
transmitted  coded  message  y(D).  The  syndromes  of  block  group  codes  also 
have  this  property  so  one  might  suspect  that  it  would  be  possible  to  use 
syndromes  to  decode  CC  in  a  manner  similar  to  that  used  for  block  codes. 

The  first  step  towards  achieving  this  goal  for  CC,  analogous  to 
that  used  for  block  codes,  is  to  find  the  general  solution  for  e(D)  of 
the  syndrome  equation  (36),  assuming  that  S(D)  is  computed  by  (34). 

That  is,  given  S(D)  by  (34),  solve  for  the  set  of  all  solutions  e(D) 
of  the  syndrome  equation  (36). 

To  find  the  general  solution  of  (36)  again  use  is  made  of  the  im¬ 
portant  invariant-factor  theorem  of  the  last  section.  This  theorem  is 
applied  to  the  matrix 


M(D)  =  HT(D) 


(37) 


Q 


the  transpose  of  the  parity-check  matrix  in  (36).  By  construction  the 
rank  of  H(D)  is  n  -  k,  the  maximum  possible  rank.  Hence  M(D)  has  the 
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Smith  normal  form  of  the  invariant-factor  theorem. 


fAl  T 

M(D)  =  L(D)  R(D)  =  H'(D) 
0 


where  L(D)  and  R(D)  are  invertible  n  x  n  and  (n  -  k)  x  (n  -  k)  matrices 
over  F(D) ,  A  =  diag  (X^  X2.  ...  Xn_k) 

A  =  diag  (X^,  Xg,  ...  X^_^)  (39) 

and  "0"  denotes  a  k  x  (n  -  k)  matrix  of  zeros.  The  X^s  in  (39)  are  the 
invariant  factors  defined  as  follows:  Let  6q  =  1 ,  let  6j  be  the  GCD  of 
all  j  x  j  minors  of  M.  Then  Xj  =  6../6^_i  and  Xj  divides  Xj+^  for  j  = 

1 ,  2,  . . . ,  n  -  k  -  1 . 

A  lemma,  due  to  Forney  [7,  Appendix  I],  is  used  to  evaluate  the 
diagonal  matrix  A  of  invariant  factors  in  (38).  In  the  present  termin¬ 
ology  this  lemma  is  requoted  as  follows: 

Lemma  ( Forney) :  The  (n  -  k)  x  (n  -  k)  minors  of  H(D)  are  equal  up 
to  scalar  field  elements  in  F  =  GF(q)  to  the  k  x  k  minors  of  G(D). 

Since  the  basic  encoder  has  a  generating  matrix  G(D)  of  form  (21), 
the  k  x  k  minors  of  G(D)  have  a  GCD  equal  to  1.  Hence  by  Forney's  lemma 
the  (n  -  k)  x  (n  -  k)  minors  of  H(D)  also  have  a  GCD  equal  to  1.  Thus 


1  “  6n-k  =  5n-k-l  =  *•*  =  61 


The  invariant-factor  theorem  was  developed  by  the  British  mathe¬ 
matician  H.J.S.  Smith  in  the  middle  of  the  19th  century. 


.***.,..  ■**■ 


iTv 


* 
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and  the  Invariant  factors  of  H^(D)  are  all  1.  Therefore,  A  =  I  ^  and 
by  (38) 


M(D)  =  L(D) 


n-k 


R(D)  =  H  (D) 


(40) 


is  the  Smith  normal  form  of  the  transpose  of  a  parity-check  matrix  for 
a  basic  encoder. 

To  solve  for  e(D)  first  substitute  expression  (40)  for  HT(D)  into 
(36).  This  yields 


S(D)  =  e(D)  L(D) 


n-k 


R(D) 


(41) 


Next  multiply  both  sides  of  (41)  by  R_1(D)  to  obtain 


_In-k 

'"n-k 

=  [e(D)  L ( 0) ] 

=  c(D) 

0 

0 

(42) 


where 


o(D)  =  S(D)  R_1(D)  =  [o-j (D) . on.k(D)]  (43) 

is  an  (n  -  k)-component  transformed  vector  of  S(D)  and 

c(0)  =  e(D)  L(D)  =  [c-j ( D) . en(D)]  (44) 

is  an  n-component  transformed  vector  of  the  unknown  polynomial  error 
vector  e(D) . 
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The  component-by-component  solution  of  (42)  is  obtained  by  equating 
comoonents  of  the  equation 


ej(D)  *  0j(D) 

for 

( J  '*  1 »  2 )  •••»  n  •  k ) 

(45a) 

cj(°)  =  Vn+k^ 

for 

(j  =  n  -  k  +  1 ,  n) 

(45b) 

where  t^(D)  for  (i  *  1,  2,  k)  is  an  arbitrary  polynomial  in  the 
Euclidean  ring  F[D].  Substituting  (45a)  and  (45b)  into  the  right  side 
of  (44)  and  solving  for  e(D)  yields  finally 

e(D)  *  [e] ( D) ,  ....  en(D)] 

*  [^(D),  on_k(D),  tj(D) . tfc(D)3  L"1  (D)  (46) 

as  the  general  solution  of  the  syndrome  equation  (36)  in  terms  of  the 
n  -  k  components  of  the  transformed  syndrome  a(0)  in  (42)  and  k  arbitrary 
polynomials  parameters  tj(0)  of  F[D]  for  (j  *  1,  2,  ....  k). 

Some  examples  of  the  above  technique  for  solving  the  linear  Diophan- 
tine  equations  of  the  syndrome  equation  are  now  presented.  Consider 
first  the  generating  matrix 

6(D)  *  [1  +  D2,  1  +  D  +  D2],  (47) 

of  a  (2,  1)  CC  of  constraint  length  1*3.  It  is  easily  deomonstrated 
that 
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r,wl 

1  (o>  ■  y  J 


is  the  transpose  of  parity-check  matrix.  Diagonalizing  H  (D)  with  ele¬ 
mentary  transformations  yields 


HT(D)  = 


l+D+D*.  1+D 
D 


1+D2, 


1 

—  — 

1 

=  L(D) 

J 

0 

0 

(48) 


as  the  Smith  normal  form  for  H  (D).  Substituting  (48)  in  (36)  produces 

'2,  1  + 

D 


S(D)  =  [e-j (D) ,  e2(D)3 


1+D2, 


1 

1 

J 

0 

[(1  +  D  +  D2)  e] ( D)  +  (1  +  D2)  ez(D),  (1  +  D)  e^D)  +  e2(D)] 


[e-j (D) ,  en(D)] 


(49) 


The  general  solution  of  this  equation  for  and  is 


& 


e] (D)  =  S(D)  and  e2(D)  =  t(D) 

where  t(D)  is  an  arbitrary  polynomial.  The  linear  relation  e(D) 
e(D)  L(D)  is  solved  by 


(50) 
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e(D)  *  [e^D),  e2(D)3  a  e(0)  L'^D) 


*  [e-j (D) ,  e2(D)] 


[S  ( D) ,  t(  D)  ]  = 


p ,  ”  ,1 

[l+D  ,  1+D+D^J 

f" ,  ™  ,1 

l+D  ,  1+D+D4 


=  [DS(D)  +  (1  +  D2)  t(0),  (1  +  D)  S(D)  +  (1  +  D  +  D2)  t(D)] 


where  the  solutions  S(D)  and  t(D)  in  (49)  have  been  substituted  for 
e^O)  and  e2(D),  respectively.  Equating  coefficients  yields 


ei(D)  =  DS(D)  +  (1  +  D2)  +  (D) 


e2(D)  =  (1  +  D)  S(D)  +  (1  +  D  +  D2)  t(D)  (51) 


as  the  general  solution  for  the  syndrome  equation  in  (36)  for  this  ex¬ 
ample  of  a  CC  where  t(D)  is  an  arbitrary  element  in  F[D].  That  (51) 
is, in  fact, the  solution  of  (36)  can  be  verified  by  substitution. 

For  the  next  example  consider  the  generating  matrix 

G(D)  =  [1  +  D2,  1  +  D  +  D2,  1  +  D  +  D2]  (52) 


of  a  (3,  1)  CC  with  constraint  length  3.  Using  the  Forney  method  de¬ 
veloped  in  the  last  section,  a  parity-check  matrix  for  G(D)  is  readily 
calculated  to  be 


XT 


E 


The  Smith  normal  form  for  H  (D)  is  given  by 


H  (D)  =  L  0  1 


where  the  inverse  of  L  is 


D  1+D  0 


L-1  =  I  0  0 


1+D2  1+D+D2  1+D+D2 


Substituting  (53)  in  (34)  the  syndrome  is  S(D)  =  z(D)  HT(D).  Hence 
by  (36)  and  (54)  the  syndrome  equation  to  solve  is 


S(D)  =  [S-|  (D) ,  S2(D)]  =  ([e-| (D) ,  e2(D),  e3(D)]  l)  0  1 


=  [^(D),  e2(D),  e3(D)]  0  1 


By  (45a,  b)  the  solution  of  (56)  for  e ^ ( D)  is 
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e-|(0)  -  S^D).  c2{ D)  =  S2(D),  c3(D)  =  t(D)  (57) 


where  t(D)  is  an  arbitrary  element  of  F[D].  Finally  the  e^(D)  in  terms 
of  the  solutions  (57)  is,  using  (55), 

[e-j (D) ,  e2(D),  e3(D)]  =  [5,(0),  S2(0).  t(D)]  L"1 

=  [DS-j(D)  +  (1  +  D2)  t(D) ,  (1  +  D)  S-j  ( D) 

+  (1  +  D  +  D2)  t(D) ,  DS-j ( D)  +  S2(D) 

+  (1  +  D  +  D2)  t(D)] 

This  yields 

ei(D)  -  DS^D)  +  (1  +  D2)  t(D) 

e2(D)  =  (1  +  D)  S] (D)  +  (1  +  D  +  D2)  t(D) 

e3(D)  =  DS-j ( D)  +  S2(0)  +  (1  +  D  +  D2)  t(D)  (58) 


as  the  general  solution  of  the  syndrome  equation  (34)  for  the  (3,  1) 
encoder  in  (47). 

For  a  final  example  consider  the  parity-check  matrix,  H(D)  = 

[D  +  D2,  1  +  D2,  1  +  D  +  D2],  found  in  (33)  for  the  (3,  2)  CC  with  gen¬ 
erating  matrix  (10).  A  diagonization  of  HT(D)  yields  for  this  example 
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0  HD 
L-1(D)  =  1  D+D3 


D2+D3 


0  HD+D2  HD2 


where  L(D)  is  left  invertible  matrix  of  the  Smith  normal  form  in  (40) 
for  H^(D).  In  this  case  the  syndrome  equation  to  solve  for  e(D)  is 


$(D)  »  [ej(D),  e2(0),  e3(D)]  L  0 


»  [^(D),  e2(D),  e3(D)]  0 


The  solution  in  (60)  for  e(D)  is 

e1  (D)  =  S(D),  g2(D)  =  t-j  (D) ,  e3  -  t2(D)  (6 

where  t^(D)  and  t2(D)  are  arbitrary  elements  or  parameters  of  F[D]. 
Solving  e(D)  L  *  e(D)  for  e(D)  in  terms  of  the  solution  (61)  for  e(D)» 
is,  using  (59), 

[e-j (D) ,  e2(D),  e3(0)]  =  [S(D)r  t^D),  t2(D)] 


0  HD  D 
1  D+D3  D2+D3 
0  1+D+D2  1+D2 


»  .«.■<  ■  j. 


which  yields,  upon  an  equating  of  coefficients, 


e^D)  *  t^D) 

e2(D)  =  (1  +  D)  S(D)  +  (D  +  D3)  t^D)  +  (1  +  D  +  D2)  t2(D) 

e3(D)  =  DS(D>  +  (D2  +  D3)  t] (D)  +  (1  +  D2)  t2(D)  (62) 

as  the  general  solution  of  the  syndrome  equation  (34)  for  the  (3,  2)  en¬ 
coder  in  (10)  in  terms  of  two  arbitrary  parameters  t^(D)  and  t2(D)  in 
F[DJ.  It  is  a  straightforward  exercise  to  verify  that  (62)  satisfies 
(34).  It  will  be  shown  in  the  next  section  by  an  example  how  to  use 
the  solutions  of  the  syndrome  equation  to  perform  optimum  syndrome  de¬ 
coding. 

IV.  SYNDROME  DECODING  OF  (n,  k)  CC 

Syndrome  decoding  of  an  (n,  k)  CC  involves  finding  a  maximum  like- 

A _ .  - 

lihood  estimate  (MLE)  e(D)  of  the  actual  error  sequence  in  the  coset, 
determined  by  (46),  of  all  possible  solutions  of  the  syndrome  equation 
(34).  In  order  to  accomplish  this  both  the  weight  or  distance  between 
codewords  of  a  sequence  and  the  type  of  channel  need  to  be  defined.  For 
an  (n,  k)  CC  a  possible  error  sequence  is  of  form  e(D)  =  [e^(D),  e2(D),  . 
en( D) ]  where  ej(D)  for  (j  *  1,  2,  ....  n)  are  finite  degree  polynomials 
over  GF(q).  The  usual  weight  for  a  discretized  channel  is  the  Hamming 
weight.  The  Hamming  weight  of  e(D)  is 

WHCe(D)3  -  t  WHCek(D)]  (63) 

3*1 
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where  WH[ej(D)],  the  Hamming  weight  of  ej(D),  is  the  number  of  nonzero 
coefficients  of  e^D).  It  is  convenient  for  this  weight  to  assume  that 
the  channel  can  be  approximated  by  a  q-ary  channel  (see  [1,  Sec.  7.2]). 

If  in  (3)  deg  [x -(D) ]  £L  -  1  for  1  <  j  <  k,  codeword  y(D)  = 

J 

(y-j ( D) »  ygfD),  ....  yn(D) )  is  said  to  be  the  L-th  truncation  of  an  (n,  k) 
CC  (see  [11,  p.  203]).  In  this  case 


deg  [y^(D)]<H+L-l  for  1  i  ^  n 


(64) 


where  M  is  the  memory.  Hence  an  L  truncated  (n,  k)  CC  can  be  considered 
to  be  a  block  code  where  each  word  has  length  n(L  +  M) .  Hence  for  a 
truncated  (n,  k)  CC  the  MLE  of  an  error  vector  is  what  it  would  be  for 
a  linear  block  code.  For  a  truncated  (n,  k)  CC  transmitted  over  a  q-ary 

A 

symmetric  channel  the  MLE  of  e(D)  is  any  vector  e(D)  of  form  (46)  such 
that 

WH[e(D)]  =  (wH  |[  0,(0),  ....  o_  .(D),  t,(D) . t.(D)]  L-1(D)|\  (65) 

t-j  ( D ) , — t^D)  \  M  1  1  n-k  I  k  1/ 


The  above  procedure  for  finding  the  MLE  e(D)  or  the  error  vector, 
needed  to  correct  a  codeword,  is  equivalent  to  the  usual  technique  for 
correcting  block  codes,  e.g.,  see  [10,  Sec.  7.5].  A  recursive  technique 
is  developed  now  by  example  to  perform  the  minimization  required  in  (65). 

/v 

The  iterative  minimization  procedure,  needed  to  efficiently  find  e(D), 
is  a  Viterbi-like  or  dynamic  programming  type  of  algorithm. 

As  an  example  of  the  new  syndrome  decoding  algorithm  consider  the 
(3,  1)  CC  with  the  generating  matrix  in  (52)  If  (52)  is  substituted  in 
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(4),  then 

[>1 ,  y2.  y3]  *  [x  +  D2x,  x  +  Dx  +  D2x,  x  +  Dx  +  D2x]  (66) 

is  the  output  of  the  encoder.  Assume  the  input  sequence  is  x  =  [0  1  0  0  1  0], 
Then  by  (66) 

y1  =  [0  1  0  1  1  0  1  0], 
y2  *  [0  1  1  1  1  1  1  0], 

y3  -  [0  1  1  1  1  l  l  0] 

are  the  three  components  of  the  transmitted  sequence.  Let  the  correspond¬ 
ing  three  received  sequences  be 

z1  =  [1  1  0  1  1  0  1  0], 

z2  "  [0  1  0  1  1  1  1  0], 

z3  =  [0  1  1  0  1  1  1  0]  (67) 

Next  substitute  the  parity-check  matrix  (53)  of  the  (3,  1)  CC  in 
(34)  to  obtain 

51  *  (1  +  D  +  D2)  z1  +  (1  +  D2)  z2 

52  -  (1  +  D  +  D2)  Zl  +  D2  z2  +  z3  (68) 


-29- 


as  the  syndromes  of  the  code.  A  calculation  of  the  syndromes  in  (68) 
in  terms  of  the  received  sequence  [z^ ,  z2,  z3]  in  (67)  yields  the  syndrome 
sequences 


51  =  [1  1  0  0  1  0  0  0  0] 

52  =  [1  1  1  1  1  0  0  0  0]  (69) 


for  this  example.  Given  the  syndrome  sequences  (69)  it  is  desired  now 
to  solve  syndrome  equation  (36)  for  the  error  vector  sequence  e(D). 

The  explicit  general  solutions  of  the  syndrome  equation  in  (36)  for 
the  components  of  e(D)  were  found  in  (58)  of  the  last  section.  These 
solutions  are  explicitly 

e-j  =  OS-j  +  t  +  Dt 

e2  =  S1  +  0S1  +  t  +  Dt  +  D2t 

e3  =  DS1  +  S2  +  t  +  Dt  +  DZt  (70) 


where  t  is  an  arbitrary  polynomial  in  F[D]  and  where  for  simplicity  in 

notation  the  functional  dependence  on  D  of  such  functions  as  S-,(D),  t(D), 

2 

etc.,  is  deleted.  Note  that  physically  the  functions  DSj,  D  t,  etc.,  in 
(69)  can  be  interpreted  as  the  function  S^(D),  delayed  by  one  time  unit, 
and  the  function  t(D),  delayed  by  two  time  units,  respectively. 

The  problem  now  is  to  find  from  (70)  and  the  given  syndrome  sequen- 

A 

ces  (69)  the  MLE  e  of  e  =  [e.j,  e2,  e3].  As  in  the  Viterbi  decoding 


-30- 


A 

algorithm  e  is  found  iteratively  or  sequentially  with  the  aid  of  a 
trellis  diagram  (see  [12]).  However,  in  the  present  case  the  underly¬ 
ing  trellis  diagram  is  "universal"  in  the  sense  that  it  is  identical 
for  all  (n,  k)  CC  of  fixed  k  and  constraint  length  L. 

For  the  present  example  the  states  of  the  trellis  diagram  are 
equivalent  to  the  states  of  the  shift  register  needed  in  (70)  to  store 
sequentially  the  delayed  versions  Dt(D)  and  D2t(D)  of  the  arbitrary 

function  t(D)  on  F.  The  block  diaqram  of  a  shift  register  to  hold  Dt 
2 

and  D  t,  the  function  t,  delayed  by  one  time  unit  and  two  time 
units,  respectively,  is  shown  in  Figure  1.  The  state  table  of  the 
shift  register  in  Fig.  1,  when  conceived  to  be  a  sequential  circuit, 
is  given  in  Figure  3.  Finally,  in  Figure  3  the  trellis  diagram  of  the 
state  table  in  Fig.  2  is  presented.  A  solid-line  transition  in  Fig.  3 
corresponds  to  the  input  t( 0)  *  0;  a  dashed-line  transition  corresponds 
to  the  input  t(D)  =  1. 

The  new  Viterbi-like  syndrome  decoding  algorithm  is  illustrated 
by  example  in  Figure  4.  The  digits  of  the  syndrome  sequences  S1  and 
S2  computed  in  (69)  are  placed  immediately  over  the  corresponding 
transition  paths  of  the  trellis.  The  vectors  [e^ ,  e2,  e3]  are  computed 
at  each  stage  from  equations  (70),  using  the  syndrome  data  for  S]t  DS1 
and  S2  and  data  t,  Dt  and  D  t,  depending  on  the  particular  path  taken. 

To  illustrate  the  above  procedure  suppose  that  the  algorithm  has 
reached  stage  2  at  state  d  =  11.  At  stage  2  the  required  values  of  the 
syndrome  sequence  needed  in  (70)  are 

S-j  =  0 ,  DSj  =  1  and  S2  =  1  (71] 


-  .«• 


■„  f’W'iiai.  *h,hhi* 
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51  *  [1  1  0  0  1 

52  =  [1  1  1  1  1 


0  0  0  0] 
0  0  0  0] 


a  * 


b  = 


c  * 


d  » 


Ot  02t 
0  0 

0  1 

1  0 

1  T 


e  =  [100  000  010  001  000  000  000  000  000] 


Note:  Each  branch  of  the  trellis  is  labeled  with  [e-j ,  e2,  e^]  where  e-j  = 

DS1  +  t  +  Dt,  e2  -  S1  +  DS1  +  t  =  Dt  +  D2t,  and  e3  =  DS1  +  S?  +  t  +  Dt  + 

D2t.  Each  node  at  stage  k  is  labeled  with  WH[ej^(D),  e^(D),  e^(D)] 

where  e^^(D)  is  polynomial  e.(D)  truncated  at  degree  k. 

J  J 


Figure  4.  A  new  Viterbi-like  syndrome 
decoding  algorithm  for  (3,  1)  CC 


Since  the  previous  two  values  of  t  leading  to  state  d  at  stage  2  are  1, 

Ot  *  1  and  ft  =  1  (72) 

If  the  t  *  1  branch  is  taken  in  the  trellis  from  stage  2  and  state  d, 
a  substitution  of  (71)  (72)  and  t  *  1  into  (70)  yields 
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[e,,  e2,  e33  =  [0,  1,  0] 


as  the  values  of  e  along  that  segment  of  the  path. 

After  stage  2  in  Fig.  3  there  are  always  two  possible  transitions 
leading  to  a  given  node  in  the  trellis.  The  transition  chosen  is  the  one 
of  minimum  weight.  This  is  precisely  the  technique  of  dynamic  programming 
to  determine  a  minimum  weight  path.  A  similar  method  is  used  in  the 
Vi terbi -algorithm  to  find  a  transmitted  codeword  that  is  closest  in 
Hamming  weight  to  the  received  codeword. 

The  trellis  diagram  shown  in  Fig.  4  is  completed  by  the  above  illus¬ 
tration  and  the  dynamic  programing  rules  for  choosing  the  "survivor" 
segment  of  path.  At  state  9  the  minimum  weight  path  in  the  trellis 
diagram  of  Figure  4  is  clearly  acdbcbaaaa.  The  branches  of 
this  path  yield 


e(D)  =  [e-| ( D) ,  e2(D),  e3(D)]  =  [1,  D2,  D3] 


as  the  estimate  of  error  vector  e(D).  Subtracting  these  estimates  of 
the  error  from  the  components  of  z  in  (67)  produces 


y1  =  [0  1  0  1  1  0  1  0] 


y2  *  [0  1  1  1  1  1  1  0] 


y3  *  [0  1  1  1  1  1  1  0] 
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The  Smith  normal  form  of  the  (3,  1)  CC  generating  matrix  G(D)  in  (52) 
is 


G(D)  [1  0  0]  B 


where 


1+D  1+D+D2  1+D+D2 

2  2 
D  1 +D  IT 

0  0  1 


Thus  the  estimate  x(0)  of  message  in  terms  of  the  estimate  of  the  trans- 

A 

mitted  codeword  y(D)  is 


y  =  x  G  =  x[l  0  0]  B 


/\ 

Solving  this  relationship  for  x, 


x 


1 

0 

0 


l+D 

1+D+D2  1+D+D2 

1 

AAA 

s  [y^  y2.  y3l 

D 

1+D2  1+D2 

0 

0 

0  1 

0 

*  (1  +  D)  y1  +  D  y2 


(74) 
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si  nee  by  (17) 


1 

0 

1 


is  the  right  inverse  of  6.  A  substitution  of  the  estimates  of  and 

^  A 

y 2  in  (73)  into  (74)  yields  finally  x  =  [0  1  0  0  1  0]  as  the  estimate 
of  the  original  message. 

In  the  above  example  the  new  syndrome  decoding  algorithm  produced 
the  original  message.  However,  if  the  number  of  errors  exceeds  the 
free  distance  d^  within  any  interval  less  than  some  multiple  of  the 
constant  length,  there  may  exist  two  or  more  paths  of  the  same  minimum 
error  weight.  In  such  a  case  a  decoding  failure  and  an  erasure  should 
be  declared. 


V.  CONCLUSIONS 

In  this  report  four  new  developments  in  (n,  k)  convolutional  codes 
with  basic  encoders  are  made.  A  method  of  Forney  is  extended  to  find 
the  syndrome  H(D)  of  any  basic  encoder  with  generating  matrix  G(D). 
Second,  a  general  method,  based  on  the  Smith  normal  for  matrices  over 
a  Euclidean  ring  is  used  to  solve  the  syndrome  equation  for  all  pos¬ 
sible  error  vectors  e(D).  The  general  solution  of  the  syndrome  equa¬ 
tion  for  an  (n,  k)  code  is  shown  in  (46)  to  have  the  explicit  form, 


e(D)  =  [o^O),  ....  on.k(0),  tj  ( D) ,  ...  tk(D)]  L_1(D) 
where  t^(D)  for  (1  =  1,  2,  ...»  k)  is  an  arbitrary  polynomial  in  the 


Euclidean  ring  F[D]  and  o.{0)  for  (j  =  1,2,  ...»  n  -  k)  computable 

J 

linear  functions  of  the  (n  -  k)  syndromes  S-j(D),  ....  Sn_^(D). 

Next  a  Viterbi-like  algorithm  is  developed  to  find  the  minimum 

A 

Hainming-weight  error-vector  e( 0)  from  all  solutions  of  the  syndrome 

A 

equation.  e(D)  is  the  maximum  likelihood  estimate  (MLE)  of  e(D)  within 

/\ 

the  coset  of  all  solutions  of  the  syndrome  equation.  The  estimate  e(D) 

A 

is  subtracted  from  the  received  codeword  z(D)  to  obtain  the  MLE  y(D)  of 
the  transmitted  codeword.  Finally  a  method  of  Forney  [7]  and  Massey 
and  Sain  [9]  is  extended  and  applied  to  find  the  inverse  circuit  needed 

A  /V 

to  obtain  the  decoded  message  x(D)  from  y(.D). 

The  new  syndrome  decoder  for  the  (n,  k)  CC  developed  herein  appears 
to  be  comparable  in  complexity  to  the  Viterbi  decoder.  Possibly  the 
control  logic  and  the  computations  associated  with  the  trellis  are  some¬ 
what  simpler  in  the  new  decoder.  Another  advantage  of  the  new  encoder 
may  be  obtained  from  the  ease  with  which  codes  with  the  same  constraint 
length,  but  with  different  rates,  can  be  switched.  Detailed  comparisons 
of  the  new  syndrome  decoder  with  the  Viterbi  decoder  are  clearly  topics 
for  several  future  studies. 
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